Toward Programming a Collaborative Robot by Interacting with Its Digital Twin in a Mixed Reality Environment

Realtime Collaborative Mixed Reality Environment with Force Feedback

A low cost Mixed Reality implementation with force feedback as a base for further empirical studies of collaboration in distributed real and virtual environments will be presented. It will be shown, how the system can be used to get more insight in tangible cooperation between humans, avatars or in general real and virtual systems. This application is related to Hyper-Bonds, a unified concept t...

Advancing student interaction with a learning robot: Digital twin, connectivity, and augmented reality

During interaction with learning robots, students often experience difficulties understanding the robot intent and its practical realization. To address this challenge, we propose a connected environment that integrates the robot, its digital twin and virtual sensors. The environment supports digital experiments that enable the physical robot to determine optimal policy for performing a manipul...

Robot Programming by Demonstration in Virtual Reality

Collaborative Mixed Reality

Virtual Reality (VR) appears a natural medium for computer supported collaborative work (CSCW). However immersive Virtual Reality separates the user from the real world and their traditional tools. An alternative approach is through Mixed Reality (MR), the overlaying of virtual objects on the real world. This allows users to see each other and the real world at the same time as the virtual imag...

A Mixed Reality Teaching and Learning Environment

This work in progress paper describes collaborative research, taking place on three continents, towards creating a ‘mixed reality teaching & learning environment’ (MiRTLE) that enables teachers and students participating in realtime mixed and online classes to interact with avatar representations of each other. The longer term hypothesis that will be investigated is that avatar representations ...